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SPECTRAL IMAGING OF BIOLOGICAL SAMPLES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application claims priority to U.S. Application Serial No. 10/669,101 entitled 
"SPECTRAL IMAGING OF DEEP TISSUE" and filed on September 23, 2003. 

BACKGROUND 

Optical imaging of deep tissue is used to probe structures within biological 
specimens for laboratory research and biomedical purposes. This includes the imaging of 
internal organs and subdermal tissue in animals such as mice, zebrafish, or humans, and 
one of flie goals is to leam about internal stmctures without surgery or otiier intrasive 
measures. 

In one technique of deep tissue imaging, fluorescent agents which are associated 
with a specific target in the specimCTi are imaged by exciting them with illunmiation. light, 
causing them to fluoresce; the fluorescent emission is separated firom the illumination 
light, which has a different wavelength, by barrier filters and then is detected using a very 
sensitive camera such as a cooled CCD detector. In other techniques, ttie specimen is 
modified using agents that cause it to produce material that is inherently fluorescent, with 
the most conamon example being green fluorescent protein (GFP). Further techniques 
involve use of quantimi dots as luminous probes. 

As used herein, compounds such as fluorescent dyes, fluorescent proteins such as 
GFP, quantum dots, surface-enhanced Raman reagents, as well as related compounds or 
others used for similar purposes, are all examples of a 'target compound" of a 
measurement. 

The signals produced in such experiments are typically weak. In general, robust 
detection of the weak levels of light emitted firom the de^ structures is beneficial because 
it provides earlier, or more reliable, detection of the structures being studied. Also, it may 
enable detection of lower levels of the target compound. Accordingly, techniques or 
apparatus used for deep tissue imaging are valued if they offer a low detection threshold. 

SUMMARY 

The inventors have recognized that one can successfiiUy use spectral 

discrimination techniques to accurately image one or more target compounds in a deep 

tissue sample, such as a subdermal tissue or an organ in an animal or a human. For 
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example, one collects spectrally resolved information about light coming from different 
spatial locations in a sample, and then decomposes the spectrally resolved information 
into contributions from estimates of the pure spectra corresponding to different 
components in the sample (e.g.^ autofluorescence and one or more target compounds)- 

5 This decomposition can be used to reconstruct one or more images that preferentially 
show a selected component. The spectrally resolved information typically corresponds to 
a spectral image cube in which each pixel includes a sample emission spectrum coming 
from a corresponding spatial location. 

The inventors have also developed algorithms that are particularly useful for 

10 estimating the pure spectrum of one or more of the sample components from such spectral 
image cube data, even where one or more of tiie components are only present in a mixed 
form (i.e., light from one components overlaps both spatially and spectrally with light 
from another component). These pure spectra can then be used in the decomposition of 
the spectral image cube data into selected component images. These algorithms are 

15 usefiil not only for deep tissue samples, but for biological samples in general. Moreover, 
in some embodiments the algorithms require little or no user input. 

In some embodiments, the algorithms recognize that an accurate estiiiiate for the 
pure spectrum of a first component that is only present in the image cube in ndbced form 
can be determined by using at least part of the image cube data and a separate estimate for 

20 the pure spectrum of at least a second component present in the mixture. The estimate of 
the piue spectrum for the second component can be based on other parts of the image 
cube data or from prior knowledge. In the simplest example, a scaled amovmt of the 
spectral estimate for the second component is subtracted from the mixed signal spectrum 
to reveal an estimate for the pure spectrum of the first component. For example, the 

25 scaling can be set to acheive small, but non-zero signal values in each spectral channel. 

We now generally summarize at least some of the different aspects and features of 
the invention. 

In general, in one aspect, the invention features a method including: (i) providing 
spectrally resolved information about light coming from different spatial locations in a 
30 sample (e.g., a deep tissue sample) in response to an illumination of the sample, wherein 
the light includes contributions from different components in the sample; and (ii) 
constmcting an image of the sample based on the spectrally resolved indformation to 
preferentially show a selected one of the components. Typically, the spectrally resolved 
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information includes information correspondiag to at least three, and preferably four or 
more, different spectral weighting functions (e.g., different spectral bands). 

The method may further include decomposing the spectrally resolved information 
for each of at least some of the different spatial locations into contributions from a 
5 spectral estimate associated with each of at least one or more of the components in the 
sample. The construction of ttie image may be based on this decomposition. Also, one or 
more of the spectral estimates may be estimates of the pure spectra for the components. 
The pure spectrum of a given component corre^onds to the spectrally resolved 
information that would be observed if only that component contributes to the light being 
10 measured (for a given spatial location). 

The method may further include any of the following features. 
The spectrally resolved information may include information about a set of 
images in which the li^t coming from the sample is spectrally filtered, wherein the 
spectral fiiltering for each image corresponds to a different spectral weighting function. 
15 The spectrally resolved information may include information about a set of 

images in which lig^t used to illuminate the sample is spectrally filtered, wherein the 
spectral filtering for each image corresponds to a different spectral wei^ting function. 

The different spatial locations typically correspond to common pixels in the set of 
images. The different spectral weighting functions can correspond to different spectral 
20 bands. There may three, or more preferably, four or more, images in the set of images. 

The information about the set of images may include a series of values at each of 
the pixels, wherein each value is related to an intensity of the light coming from the 
sample with respect to a corresponding one of the spectral weighting functions. The 
spectrally resolved information for each spatial location typically includes information 
25 corresponding to at least three, and more preferably, four or more different spectral 
weighting functions. 

The spectrally resolved information may include a spectral image cube. 
The light coming from the sample may include fluorescence from the sample, 
reflectance, phosphorescence, scattering, or Raman scattering from the sample, or it may 
30 include light transmitted through the sample. 

At least one of the components may relate to autofluorescence. 
At least one of the components may include a target compound (e.g., a fluorescent 
protein or a quantum dot). For example, the selected component may be the component 
including the target compound. 
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The method may further include illuminating the sample and collecting the 
spectrally resolved information. For example, collecting the spectrally resolved 
information may include using a liquid crystal tunable spectral filter, an acousto-optical 
tunable spectral filter, a set of spectral filters, a spectral filter wheel, a dispersive prism, a 
5 grating, a spectrometa:, or monochromator. 

The image of the selected component may includes an image in which signal firom 
the other components is reduced relative to signal firom the selected component. 

The method may fiarther include constracting a second image of the sample based 
on the decomposition to preferentially show a second one of the components. The 
10 method may also include constructing a third image of the sample based on the 
decomposition to preferentially show a third one of the components. 
The sample maybe a living organism (e.g., a mammal). 
The sample may include deep tissue, tissue slices, cells, subdermal tissue, or a 
microscope slide carrying biological material. 
1 5 Constructing the image based on the decomposition may include constracting the 

deep tissue image based on the contributions at different spatial locations of the spectral 
estimate associated with the selected component 

The decomposition may be a linear decomposition. For example, tiie 
decomposition may include solving at least one component of a matrix equation in which 
20 one matrix in the equation is based on the spectrally resolved information and another 
matrix in the equation is based on the spectral estimates. 

At least one of the spectral estimates may be provided independently of the 
spectrally resolved information. . 

At least a first one of the spectral estimates for a first one of the components may 
25 be determined firom the spectrally resolved information. For example, all of the spectral 
estimates may be determined from the spectrally resolved information. The spectral 
estimates may be determined from the spectrally resolved information by using an 
unsupervised classification technique or a supervised classification technique. One 
example of an unsupervised classification technique includes averaging the spectrally 
30 resolved information for multiple ones of the spatial locations. One example of a 
supervised classification techique determining the first spectral estimate from the 
spectrally resolved information a region including one or more of the spatial locations, 
wherein the region is associated with the first component. 
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The jSrst spectral estimate may be derived from the spectrally resolved 
information from a first set of one or more spatial locations in which the light includes 
contributions from multiple ones of the components. In such case, the first spectral 
estimate can be derived from the spectrally resolved information from the first set of 
5 spatial locations and a spectral estimates for a second one of the components. 

For example, deriving the first spectral estimate may include calculating a 
remainder spectrum based on the spectrally resolved information from the first set and the 
spectral estimate for the second component. The remainder spectrum can be calculated at 
each of one or more of the spatial locations in the first set of spatial locations. 
10 Alternatively, the remainder spectrum can be calculated based on an average of the 
spectrally resolved information in the first set of spatial locations and the spectral 
estimate for the second component. 

The spectral estimate for the second component may be derived from the 
spectrally resolved information. For example, the spectral estimate for the second 
1 5 component may be determined from the spectrally resolved information by using an 
unsupervised classification technique, such as averaging. Alternatively, the spectral 
estimate for the second component may be derived from a region including one or more 
of the spatial locations, wherein the region is associated with the second component. 

Deriving the first spectral estunate may includes adjusting values corresponding to 
20 the spectrally resolved information for the first set of spatial locations to remove a 
contribution (e.g., a maximal contribution) from the second component based on the 
spectral estimate for the second component. The maximal contribution may be based on 
an error fimction analysis of signal in each spectral chaimel of the adjusted values. For 
example, the error function analysis tends to maintain nonnegative signal in each spectral 
25 channel of the adjusted values. 

For example, the values may include a series of at least some of the values for 
each of the spatial locations in the first set, and removing the contribution from the 
second component based on the spectral estimate for the second component may include 
subtracting an optimized quantity of the spectral estimate for the second component from 
30 each of the series of values. 

The optimized qiiantity for at least a first of the series of values may be based on 
miiximizing an error fimction of a difference spectrum that includes a difiference between 
the first series values and the quantity to be optimized multiplied by the spectral estimate 
for the second component, wherein the error function is minimized over the spectral 
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channels. The difference spectrum may further include a constant that is also optimized 
over the spectral chaimels. The error function typically favors positive values of the 
difference spectrum over negative values of the difference spectrum. For example, one 
useful error fiinction is iacludes {e'^ +1)A^ , where A is the difference spectrum. The 
error function may also be normalized by the magnitudes of the first series of values and 
the spectral estimate for the second component. 

The decomposition may include: (i) a first decomposition of the spectrally 
resolved information at multiple spatial locations into contributions from initial spectral 
estimates associated with at least some of the components in the sample; (ii) improving an 
accuracy of at least some of the initial spectral estimates based on the first decomposition; 
and (iii) at least a second decomposition of the spectrally resolved information at multiple 
spatial locations into contributions fix)m the improved spectral estimates. 

In another aspect, the invention features an apparatus including: (i) a sample 
holder configured to support a sample (e.g., a deep tissue sample); (ii) an illumination 
source to illuminate the sample; a detector positioned to detect light from the sample; and 
(iii) an electronic processor coupled to the detector. The electronic processor is 
configured to implCTient any of the method steps described above, including interacting 
with a user as necessary. 

The apparatus may further include a spectral filtering means positioned between 
the sample and the detector. For example, the spectral filtering means may include a 
liquid crystal tunable spectral filter, an acousto-optical tvmable spectral filter, a set of 
spectral filters, a spectral filter wheel, a dispersive prism, a grating, a spectrometer, or 
monochromator. 

Alternatively, or in addition, the apparatus may include a spectral filtering means 
positioned between the illumination source and the sample. 

Also, the illumination source itself may provide tunable excitation light. For 
example, it may be a multispectral diode or LED array. 

In genial, in yet a further aspect, the invention features a method including: (i) 

providing a set of images of spectrally filtered radiation emitted from a biological sample 

in response to an illumination, wherein the sample includes a component supporting a 

target compound, the emitted radiation includes emission from the target compound and 

emission from one or more additional components in the sample, and each image 

corresponds to a different spectral weighting function for a common set of pixels; and (ii) 

processing the images of the spectrally filtered radiation to construct an output image of 
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the sample in which signal from the additional components is reduced relative to signal 

from ttie target compoimd. The processing includes calculating a remainder spectrum for 

one or more pixels in the set of images based on an estimate for an emission spectrum of 

at least one of the components. 

In yet another aspect, the invention features a method including: (i) illuminating a 

sample to cause the sample to emit radiation, wherein the sample includes deep tissue 

supporting a target compound, and wherein the emitted radiation includes emission from 

the target compound and emission from one or more other components in the sample; (ii) 

spectrally filtering the emitted radiation with each of a plurality of different spectral 

weighting functions; (iii) storing an image of the spectrally filtered radiation for each of 

the spectral weighting fimctions; and (iv) processing the stored images to construct a deep 

tissue image of the sample in which signal from the other compoimds is reduced relative 

to signal from the target compound. 

In another aspect, the invention features a method including: (i) providing a 

plurality of images of spectrally filtered radiation emitted &om a sample in response to an 

illumination, wherein the sample includes deep tissue supporting a target compound, 

wherein the emitted radiation includes emission from the target compound and emission 

from one or more other components in flie sample, and wherein each image corresponds 

to a different spectral weighting function; and (ii) processing the images of the spectrally 

filtered radiation to construct a deep tissue image of the sample in which signal from the 

other compounds is reduced relative to signal from the target compoimd. 

In yet another aspect, the invention features an apparatus including a computer 

readable mediiun which stores a program that causes a processor to: (i) receive a plurality 

of images of spectrally filtered radiation emitted from a sample in response to an 

illimiination, wherein the sample includes deep tissue supporting a target compound, 

wherein the emitted radiation includes emission from the target compound and enoission 

from one or more other components in the sample, and wherein each image corresponds 

to a different spectral weighting fimction; and (ii) process the images of the spectrally 

filtered radiation to construct a deep tissue image of the sample in which signal from tiie 

other compounds is reduced relative to signal from the target compound. 

In yet another aspect, the invention features an apparatus comprising: (i) a sample 

holder configured to hold a sample including deep tissue, wherein the deep tissue 

supports a target compound; (ii) an illumination soxirce configured to illimiinate the 

sample to cause it to emit radiation, wherein the emitted radiation includes emission from 
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the target compound and emission from one or more other components in the sample; (iii) 
an imaging system conjfigured to image the emitted radiation to a detector; (iv) a tunable 
"spectral filter configured to spectrally filter the emitted radiation with each of a plurality 
of different spectral weighting functions; (v) a detector configured to store an image of 
5 the spectrally filtered radiation for each of the spectral weighting functions; and (vi) a 
electronic processor configured to process the store images to constmct a deep tissue 
image of the sample in which signal from the other compounds is reduced relative to 
signal from the target compoimd. For example, the sample holder may configured to hold 
an animal, such as a ma3tnmel, like a mouse, rabbit, or human. Also, for example, the 
10 imaging system may have a demagnification greater than or equal to 1, and, for example, 
the imaging system may be configured to image a field of view having a diagonal 
dimension greater than about 2 cm onto the detector. 

Embodiments of these various aspects may include any of the following features. 

The sample including the deep tissue maybe a Uving organism, such as an animal 
15 or a mammal. For example, the animal may include a mouse, a rabbit, a zebrafish, or a 
human. Also, the deep tissue may be an internal organ of the living organism, and 
the deep tissue may lie within about 2 mm or more of the living organism. 

The deep tissue may be subdermal tissue. 

The emission from the other components of the sample may include 
20 autofluorescence from tissue overlying the deep tissue. 

The emission from the other components of the sample may include 
autofluorescence from one or more layers of tissue in the sample different from a layer of 
tissue including the deep tissue. 

The target compoimd may be any of, for example, a fluorescent probe boimd to at 
25 least a portion of the deep tissue, a quantum dot bound to at least a portion of the deep 
tissue, a green fluorescent protein (GFP) bound to at least a portion of the deep tissue, a 
yeUow fluorescent protein (YFP) boimd to at least a portion of the deep tissue, and a red 
fluorescent protein (RFP) bound to at least a portion of the deep tissue. 
The emission from the target compound may be fluorescence. 
30 At least some of the spectral weighting functions may correspond to particular 

wavelength bands. For example, all of the spectral weighting functions correspond to 
particular wavelength bands. Alternatively, at least some of the spectral weighting 
functions may correspond to sinusoidal weightings of multiple wavelength bands. 
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The spectral jfiltering may include using any of a liquid-crystal, tunable optical 
filter, an interferometric optical filter, and a filter wheel containing a plurality of band 
pass filters. 

Each stored image may include an intensity value for each of multiple pixels. 
Processing the stored images may include constructing the deep tissue image 
based on a weighted superposition of signals in the stored images. 

Processing the recorded images may include constructing the deep tissue image 
based on the recorded images and at least one emission spectrum for the other 
components in the sample. For example, constructing the deep tissue image may include 
calculating a remainder spectrum for each pixel in the set of stored images based on the at 
least one emission spectrum for the other components. 

Similarly, processing the recorded images may include constructing the deep 
tissue image based on the recorded images and an emission spectrum for the target 
compound. For example, constmcting the deep tissue image may include calculating a 
remainder spectrum for each pixel in the set of stored images based on the emission 
spectrum for the target compound. 

Also, processing the recorded images may include constmcting the deep tissue 
image based on the recorded images, at least one emission spectrum for the other 
components in the sample, and an emission spectrum for the target compound. For 
example, constructing the deep tissue image may include solving at least one component 
of a matrix equation in which one matrix is based on the stored images, and another 
matrix is based on the emission spectra. 

The deep tissue may support multiple target compoxmds and processing the stored 
images may include constmcting a deep tissue image for each of the target compounds. 
For example, processing the recorded images may include constmcting the deep tissue 
images based on the recorded images and emission spectra for the target compounds. 
Furthermore, processing the recorded images may include constructing the deep tissue 
images based on the recorded images, the emission spectra for the target compounds, and 
at least one emission spectrum for the other components in the sample. 

The plurality of the different spectral wei^ting functions may include fouar or 
more spectral weighting fiinctions. 

Unless otherwise defined, all technical and scientific terms used herein have the 
same meaning as commonly understood by one of ordinary skill in the art to which this 

invention belongs. All publications, patent appUcations, patents, and other references 
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mentioned herein are incorporated by reference in their entirety. In case of confhct, the 
present specification, including definitions, will control. 

Other features, objects, and advantages of the invention will be apparent firom the 
following detailed description. 

5 DESCRIPTION OF DRAWINGS 

The invention will now be further described merely by way of example with 
reference to the accompanying drawings. 

Figure 1 is a schematic diagram of a spectral imaging systOTi. 

Figure 2 is an image of a mouse which has been implanted with a fluorescently 
10 labeled tumor, imaged at a single spectral band of X = 530 nm. 

Figure 3 is a graph of the emission spectrum of autofluorescence and the 
estimated emission spectrum of the target compound for the sample of Figure 2, with the 
light-colored hne showing the spectrum for the autofluorescence and the dark-colored 
line showing the estimated spectrum for the target compound. 
15 Figures 4A and 4B are images showing the results of spectral umixing operations 

that used as spectral end-members tiie measured mouse autofluorescence signal spectrum 
and the mixed signal spectra detected over the region of the tumor, respectively. 

Figure S is a set of images forming an image cube. 

Figure 6 is an image of the target compound emissions from the mouse of Figure 
20 2, with the autofluorescence signal removed using spectral techniques and end-member 
spectra that are estimated as well as directly measured. 

Figure 7 is an image of the autofluorescence emissions from the mouse of Figure 
2, with the target compound emissions separated using spectral techniques and end- 
member spectra that are estimated as well as directly measured. 
25 Figure 8 is a flow-chart of one embodiment, based on acquisition of a spectral 

cube and subsequent analysis by linear unmixing. 

Figure 9 is graph of the spectral properties of each spectral band in the 
embodiment of Figure 8. 

Figure 10 is a flow-chart of yet another embodiment in which the spectral filtering 
30 is performed interferometrically. 

Figure 1 1 is a graph of the spectral properties of the spectral weightings used in 
die embodiment of Figure 10. Like refer^ce symbols in the various drawings indicate 
like elements. 
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Figure 12 is a flow-chart of another embodiment which incorporates spectral 
component decomposition to estimate the spectra of the autofluorescence and the target 
compoxmd(s). 

Figures 13A, 13B and 13C are exemplary images component abundance images 
generated by a typical non-life sciences end-member detection algorithm. 

Figures 14A, 14B and 14C are output images generated by an unsupervised 
iterative remainder technique. 

Figures 15 A and 15B are output images generated by a supervised iterative 
remainder technique. 

Figure 16 is a flow-chart for a process for extracting spectral vectors. 

Figure 17 is a schematic diagram of a spectral imaging system. 

DETAILED DESCRIPTION 

Overview 

The invention features methods and apparatus for reducing the detection 
sensitivity level of a target compound in a biological sample (including deep tissue in the 
sample) through spectral discrimination. This involves measuring spectrally resolved 
information about the light coming from each of multiple spatial locations in the sample. 
Sometimes, the data is referred to as an "image cube," with the spectrally resolved 
information corresponding to values along one dimension of the cube and the spatial 
locations (or pixels) corresponding to the other two dimensions of the cube. Beneficial 
result can be obtained despite low light levels typical for deep tissue imaging. 
Furthermore, algorithms for processing spectrally resolved image data are disclosed that 
are useful not only for deep tissue imaging, but for processing spectrally resolved image 
data of biological samples in general. In some cases, the processing can proceed in a 
highly automated fashion, without Uttle or no user-guidance, while still producing 
accurate images of one or more selected components in the biological sample. 

Spectral imaging techniques (e.g., fluorescence imaging) can be used with 
samples that are labeled with fluorescent tags or are genetically modified so that one or 
more target compounds fluoresce or which are simply targets that fluoresce. This 
fluorescence from one or more target compounds is called **target fluorescence." 
However, in addition to components such as flie target compounds, a sample may include 
other components that each emits radiation according to a corresponding emission 
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spectrum. For example, there may be other compounds or materials in a sample that are 
not labeled or are not genetically modified that may also fluoresce at some level. This 
unknown and/or background fluorescence is called "autofluorescence." 

This autofluorescence interferes with quantitative measurements of target 
fluorescence, and in some cases can be many times biigjiter liian the target fluorescence. 
Some particular applications of interest are in the life sciences, including in-vivo 
fluorescence imaging, and fluorescence microscopy; however, the techniques described 
here are also effective in other applications such as bright-field microscopy. 
Autofluorescence can also include other spectral signatures such as instrument spectral 
responses, or absorptions from other constituents or chromaphores in transmitted light 
(e.g., bright-field) applications. Moreover, there may be multiple components, each of 
which give rise to different autofluoresence spectra. 

Autofluorescence typically has emission spectra that differ firom the target 
fluorescence emission spectra, providing an opportunity to apply spectral unmixing 
techniques to separate the target fluorescence firom autofluorescence in each detected 
signal spectrum at a pixel in a detected image cube. In other words, the signal spectrum 
can be decomposed into separate contributions fi"om the target fluorescence and the 
autofluorescence. This spectral unmixing produces a high contrast image of the labeled or 
genetically modified portion of the sample by removing the portion of a detected signal 
that can be attributed to autofluorescence. In some cases, more than one compound is 
labeled or modified with the goal being to produce multiple images representing 
concentrations of each target compound isolated firom the autofluorescence and the other 
target compoimds. 

To accurately apply spectral umiuxing tools, it is usefiil to obtain the pure 
emission spectrum of each target compound and of each autofluorescence component that 
may contribute to an overall detected spectrum. The more accurately the spectral shapes 
of such component spectra are known, the more accurately the mixed signal spectra in the 
image cube can be uimfuxed or decomposed to generate individual images representing 
quantities of target compounds and/or autofluorescence components. The pure emission 
spectrum for a given component is the signal spectrum that would be measured if only 
that component contributed to the measured light, such as, for example, if that component 
were isolated firom the other components. 

However, rarely are the target compound spectra represented in their "pure" form 

within a signal spectrmn at a given pixel of the detected image cube. In some cases, 
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publidied spectra of various fluorescent labels can be used. For accurate results in these 
cases, the system responses should be calibrated out of the system being used, as well as 
the system on which that tiie spectra were origmally measured. Another way to obtain the 
spectra from each target compound is to individually isolate each target compound and 
collect the spectrum of each on the same system to be used for subsequent in-vivo 
experiments. However, this isolation of target compounds is often impractical. Also, the 
spectra resulting from labels often change when the labels are in in-vivo samples, making 
spectra collected from target compomids isolated from the in-vivo sample inaccurate. 

In some cases it is useful to process a sample in its current state without a priori 
knowledge of the component spectra represented within the signal spectra of an image 
cube obtained from the sample. Therefore it is useful to be able to accurately determine 
the individual component spectra based on the image cube data so that spectral uimaixing 
can be performed and images of individual target compounds can be generated. 
Techniques described below, such as the "remainder techniques," are particularly well 
suited for biological samples due to the typical characteristics of the component spectra 
involved, as described in more detail below. 

Another useful aspect of these techniques described below is their compatibility 
with automation techniques. For example, in some implementations, it is not necessary to 
have a user visually identify features in an image based on specialized knowledge. In 
other implementations an unskilled user can provide feedback based on an initial 
automated step. 

Imaging System 

A schematic diagram of a spectral imaging system 100 for imaging biological 
samples is shown in Figure 1. System 100 includes a sample holder 110 suitable for 
holding a specimen 112, For example, the specimen 112 may be a living organism, such 
as an animal or manmial. A target compoxmd is associated with (e.g., boimd to or 
accumulated in) selected portions of tissue (e.g., deep tissue) in the specimen 1 12. An 
illuminator 120 (e.g., a metal halide lamp or other lamp, a laser, an light emitting diode 
array, or any other soxirce of electromagnetic radiation) directs excitation light 122 to the 
specimen 112 to excite emission (e.g., fluorescence) from tiiie target compound in the 
tissue. Typically, tiie excitation light will also cause the autofluoresence from the other 
components in the specimen 112. Therefore, the electromagnetic radiation 130 emitted 
from the specimen 1 12 includes emission from the target compound as well as 
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autofluorescence. Emitted radiation 130 is collected by imaging system 140 and imaged 
onto a camera 150, 

Because system 100 is designed to be able to image deep tissue in relatively large 
specimens (e.g., living organisms), the imaging system typical provides a demagnification 
of one or more, or even 2 or more. That is, the image on the camera is the same size or 
smaller than the object field of view for the imaging system. Also, the object field of 
view for the imaging system is typically greater than about 2 cm (or greater than about 3 
cm) along a diagonal dimension. 

Furtheraiore, although Figure 1 shows emitted radiation 130 as being collected 
fi-om an opposite side of the specimen 112 relative to excitation light 122, in other 
embodiments, the emitted radiation can be collected Jfrom the same side as, or at an angle 
to, that illuminated by the excitation Ught. Moreover, illumination may be provided from 
multiple sides of the specimen 1 12. 

Positioned between the specimen 112 and camera 150 is a tunable optical filter 
module 160 (e.g., a liquid crystal, tunable optical filter, an mterferometric optical filter, or 
a motorized filter wheel). Optical filter module 160 spectrally filters emitted radiation 
130 according to each of a plurality of spectral weighting fimctions (for example, four or 
more spectral wei^ting fimctions). The spectral weighting fimctions may correspond to 
specific wavelength bands, or may be more complicated fimctions such as a sinusoid 
distribution of pass bands. The optical filter module 160 may also optionally include 
other filters including, for example, a filter that reduces the amoxmt of excitation light 122 
that can enter the camera 150. Camera 150 records images of the spectral filtered emitted 
radiation 170 for each of the different spectral weighting functions, and sends the image 
data to a computer 180 for analysis. As described in greater detail below, the computer 
processes the image data based on the different spectral weighting fimctions, and one or 
more emission spectra corresponding to pure target compoimd, pure autofluorescence of 
one or more other components of the specimen 1 12, or both, to construct an image that 
suppresses the autofluorescence signal to reveal the target compound. 

In some implementations, a portion of the system 100 (e.g., the portion of the 
system 100 between the illuminator 120 and the camera 150, inclusive) is optionally 
enclosed in a housing 190, for example, to reduce the amount of stray light^^e.g., room 
Ught) that can be imaged onto the camera 150 or that can interact with the specimen 1 12. 
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S pectral BT ^^f?"P TechnignAQ 

In what follows, we describe the context for the spectral imaging of the biological 
samples, specific examples including deep tissue imaging, and spectral uimiixing 
techniques for constructing the images. 

Si gnal Strength 

It is a hallmark of imagmg structures in biological samples (and particularly in 
deep-tissue samples) via target compounds that the optical signals are relatively weak. 
Accordingly, many practitioners place prime importance on the properties of the detector, 
and on the efficiency of all elements in the optical path, such as the lenses and the 
blocking filter used to block the excitation light from reaching the detector. Yet while the 
present art of CCD detectors and the like is suitable for detecting low light level signals, it 
does not adequately address the problem of disbriminating between light emitted by the 
target compound, and light from other sources such as autofluorescence. Thus one's 
detection level in practice may be set by the level of confounding Ught arising from sites 
elsewhere within the specimen, rather than consid^ations such as readout noise in one's 
detector, or the light gathering power of the objective. 

Put more precisely, one's detection limit can be seen as the greater of one's 
detector noise or the confoimding signal flux which is presented to the detector; expressed 
in either case as the equivalent concentration of target compound in the specimen to 
produce light of that signal level at the detector. 

Unless the light emitted by the target compound dominates over all otihier sources 
in the specimen, one is often limited by the confoimding signal rather than by one's 
detection apparatus. Some level of autofluorescence is inherent in biological samples 
when they are illxmiinated with Ught of visible range, especially when the light is green 
(550 nm) or shorter. So despite the use of optimized target compovinds, autofluorescence 
arising at or near the specimen surface can often set the detection limit. 

Further, emission from target compounds within deep tissue can be attenuated by 
scattering or absorption as it travels from the site of emission to the surface of the 
specimen. The signal level reaching the imaging system is thus reduced, while light that is 
generated at the surface layer of the specimen is not similarly attenuated. The details of 
this effect depend on the geometry of the sample specimen relative to the collection 
optics, as well as the optical properties of the sample. 
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Likewise, the illumination light may be attenuated or scattered as it travels from ' 
the source of illumination through Hie surface layers of the specimen on its way to the 
structure being imaged. The excitation signal reaching the target site is reduced, while the 
signal developed at the surface of the specimen is not similarly attenuated. The details of 
this depend on the geometry of the illumination and collection optics, as well as on the 
optical properties of the sample specimen. 

These considerations can exacerbate the effect of autofLuorescence by increasing 
the relative contribution of autofluorescence emission to the detected signal, compared 
with emission from the target compound. 

The magnitude of the problem is illustrated by Figure 2, which is an image of the 
fluorescent emission from a mouse. The mouse was illuminated with light of 
approximately 480 nm, and the emission light was filtered by a 25 nm bandpass filter 
centered at 530 nm. There is a tumor in the lung of the mouse which expresses the green 
fluorescent protein (GFP). Yet the tumor is not easily distinguishable in the image due to 
an equal or greater signal from generalized autofluorescence, apparently developed in the 
dermal layers of the mouse. As a result, while the signal level at any point in the image is 
easily quantified, the presence of target compound, and thus the tumor, cannot be 
confirmed due to high levels of background autofluorescence which sets an equal or 
higher detection threshold than the target compound involved. 

Autofluorescence is also variable from specimen to specimen and can be 
unpredictable. Thus if an absolute flux level is used to make assessments about the target 
compound, one can obtain false positive readings. Variability can arise from factors such 
as mold or disease on the skin of the specimen. These are typically not xmiform across the 
specimen. So if one seeks to detect the presence of a target compound by comparing local 
signal levels in a given region against the mean level for the specimen, results are also not 
reliable. 

Spectral Crosstalk 

It is possible in some cases to reduce autofluorescence by choice of the 
illumination wavelength. Generally the use of longer wavelengths for illxmodnation is 
beneficial, as is known in the art, since they typically generate less autofluorescence. 
Also, it can be beneficial to choose a target compoimd whose emission light occurs at a 
dififerent wavelength range from the autofluorescence of the specimen. Yet it is typically 
not possible to choose an illvunination wavelength such there is no crosstalk. In the 
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example shown in Figure 3, the emission spectra of the target compomid, GFP (shown by 
the dark-shaded line), and of the autofluorescence (shown by the Ught-shaded line), are 
overlapping. At any wavelength where the target has substantial emission, the 
autofluorescence is also strong, so autofluorescence cannot be eliminated by use of a 
fixed optical filter or something similar. Nor does a color camera discriminate between 
two such similar green spectra. 

Yet as Figm-e 3 indicates, the spectra of GFP and autofluorescence emissions are 
nonetheless different Thus, a spectral imaging approach can distinguish the two and 
eliminate or greatly reduce the contribution of the latter signal. 

Spectral Uimiixing 

One tool for separating each pixeFs signal spectrum into its component spectra is 
linear decomposition or xmmixing. For example, one can perform a least-squares best fit 
approximation to determine how much of each individual component spectrum would be 
required to most accurately recreate the measured signal spectrum. 

Spectral unmixing uses a set of input spectra to represent the component spectra 
within the detected image cube. Typically, the input spectra are estimates of the pure 
spectra for the different components. One approach for providing input spectra for 
unmixing, if the component spectra are not available from a library, or have not already 
been collected from isolated component materials, is to assume that each of the individual 
component spectra can be represented by the spectrum of a pixel or groups of pixels 
within the image cube. 

However, this approach typically produces a poor estimate for at least one or more 
of the pure spectra. For example, rarely do the target fluorescence components exist by 
themselves, separate firom the autofluorescence components, in isolated areas within an 
image cube. The signal spectrum for a region of pixels in which a target compound 
appears is usually a mixture of component spectra. Therefore, if one estimates the pxure 
spectrum for one of the target components based on such a region, the unmixing will be 
poor - it will represent mixtures of compounds associated with the mixed component 
spectra. 

Also, in some cases it is difficult to know a priori how many actual fluorescing 
components (each associated with a corresponding component spectrum) exist within a 
sample, in order to accurately apportion the measured signal wifliin tiie image cube. If 
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some component spectra are not represented during xmmixing then the relative ratios of 
the remaining components will not be accurately detennined. 

In some cases, manually choosing from where to select the input spectra and 
choosing how many input spectra to uxmiix can work if the user can make an educated 
guess based on specialized knowledge and/or experience. Some users can work 
effectively this way if they have significant a priori knowledge of the sample. 

A good example of the pitfalls of these approaches is shown in Figures 4A and 
4B. In the image of Figure 2, a skilled user can faintly discern an area (of bluish hue in a 
corresponding color image) about where the lung should be. To an untrained eye, this 
irregularity caused by the tumor would be imperceptible. If one uses the signal spectra 
from surroimding areas as input spectra to represent autofluorescence, and the signal 
spectra from the area which looks like the tumor as input spectra to represent target 
fluorescence, and performs an unmixing using these input spectra, one arrives at the 
images shown in Figure 4A and 4B. Figure 4 A is the image of the portion of the field of 
view that most closely spectrally resembles the pixels corresponding to the area that was 
identified as autofluorescence. Figure 4B is the image of the portion of the field of view 
that most closely spectrally resembles the pixels corresponding to the area that was 
identified as the tumor. The area associated with the tumor is well defined. However, 
tiiere are problems with the images. For example, the "hole" left in the autofluorescence 
image (Figure 4A), indicates that photons that were emitted fix)m this area were 
inaccurately apportioned to the labeled tumor image. 

If one wants to measure the amount of target fluorescence as a estimate of tumor 
size, this crosstalk can lead to significant error (e.g., a measured magnitude larger than the 
actual target fluorescence). Such an error occxurs in this example because, even though 
the input spectrum used to represent the autofluorescence is primarily autofluorescence, 
the input spectrum representing the tumor is a mixture of target fluorescence and 
autofluorescence since the target compoxmd and autofluorescing material are co-locahzed. 
To perform the unmixing correctiy in this example, not only should the input 
autofluorescence spectrum be "pure," but the and input target fluorescence spectrum 
should also be "pure" (e.g., not being mixed with significant amounts of other component 
spectra, in tiiis case autofluorescence). 
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Unmixing with Pure Spectra 

Even though in some samples a component spectrum may not be represented in its 
"pure" form (i.e., substantially unmixed form, e.g., mixed with less than about 10% otiier 
components, or preferably less than about 1% other components) in any pixel's signal 
spectrum, an estimate for the pure component ^ectrum can in some cases still be 
obtained from the image cube data to use as an input spectrum for unmixing. For 
example, in some cases one component spectrum (e.g., corresponding to 
autofluorescence), identified as spectrum A, may be available in a '"pure" fomi (e.g., from 
a pixel's signal spectrum or otherwise known or available). Another component 
spectrum, identified as spectrum B, however, may not be available in a "pure" form, hi 
such cases, if spectrum B is represented in the image cube mixed only with spectrum A at • 
one or more pixels that can be identified, then spectrum A can be subtracted from this 
mixed "A + B" spectrum to obtain a pure spectrum from B. The technique for more 
accurately estimating the pure spectra from the image cube is described fiirther below. 
First, however, we describe an example in which spectral unmixing or decomposition of 
image cube data into contributions &om estimates of pure spectra for different 
components of the sample was successfully used to image a target component in a deep 
tissue sample. 

Li this example, the specimen was illuminated and the illimiination light from was 
blocked form entering the detector. This can be done using an illuminator such as the LT- 
9500 MSYS from Lighttools Research (Encinitas, CA) together with a longpass optical 
filter that transmits substantially all light X > 510 nm, placed in the path of the objective. 

The spectral imaging detector included a Qlmaging 1300C digital cooled CCD 
camera (Roper Scientific, Trenton NJ) with a 55 mm F/2.8 Nikkor macro lens (Nikon 
USA, Melville NY) , to which a VARISPEC tunable optical filter (CRI Inc, Wobum MA) 
was coupled with a mounting adaptor. The VARISPEC filter is a computer-controlled 
optical filter with 25 nm bandpass and tunable center wavelength. These were connected 
to an IBM Thinkpad computer which controls the image acquisition and performs the 
data analysis. Communication is via an IEEE-1394 interface to the camera, and an RS- 
232 interface to the VARISPEC filter. 

The VARISPEC filter uses nematic liquid crystal variable retarder elements to 

constract a tunable Lyot filter. The variable retarders are placed in optical series with 

fixed waveplates of quartz or other material, to produce a retardance that is well-known 

and electrically adjustable. Linear polarizers between successive stages of the filter act to 
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block unwanted orders so only a single peak is transmitted, and out-of-band leakage can 
be reduced to 0.01% if desired. By choice of the retarder thicknesses, one may obtain 
bandwidths ranging from 0. 1 mn to 50 nm or more. Tuning action is rapid (< 50 ms) and 
there is no image shift from tuning, which is valuable for imaging applications. 

Referring to Figure 5, the mouse of Figure 2 was imaged by taking a sequence of 
images S(x, y, Xj) (for i = Ito n, tiie number of spectral settings) each recorded using a 
spectral weighting function I| determined by the VARISPEC filter, while the center 
wavelength of the VARISPEC filter was tuned from 500 nm to 650 nm. This sequence of 
images in Figure 5 is an example of a spectral image cube 500. The different spectral 
spectral weighting functions (in this case, spectral passbands) are shown in Figure 9. The 
result is an image cube 500, with a fiill two-dimensional image of the sample for a given 
center wavelength \, and a full spectrum at a given pixel (x,y) in the images. The exact 
spectrum recorded at a given pixel depends on the amount of GFP and autofluorescence, 
and on the two spectra, as: 

S(x, y, X) = a(x, y) * F(X) + b(x,y) * G(X) 
[1], 

where (x, y) indices are used to denote a given pixel location in the images, the asterick 
denotes multiplication, X is used to denote a given wavelength (or wavelengtti band) 
of emission or detection, and 

S(x, y, X) denotes the net signal for a given pixel location and wavelength, 
F(X) denotes the emission spectrum of autofluorescence, 
G(X) denotes the emission spectrum of GFP, 

a(x, y) indicates the abundance of autofluorescence at a given (x, y) pixel location, 

and 

b(x, y) indicates flie abundance of GFP^ at a given (x, y) pixel location. 

Equation [1] states that the net signal from a given pixel location is the sum of two 
contributions, weighted by the relative amount of autofluorescence and GFP present. It is 
easier to see if one writes the above equation for a single pixel: 
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S(X) = aF(X) + bG(X) 
[2]. 

F and G may be termed the spectral eigenstates for the system because they correspond to 
the pure spectra for the autofluorescence and GFP emission, which are combined in 
various amounts according to the amoimt of autofluorescence and GFP emission, to 
produce an observed spectrum or signal spectrum S. Thus, the signal spectrum is a 
weighted superposition corresponding to separate contributions from the autofluorescence 
and the GFP emission. 

Now if the emission spectra of the autofluorescence and of the GFP are known (or 
can be deduced, as described below), one may invert equation [2] by linear algebra to 
solve for a and b, provided that the spectrum S has at least two elements in it; i.e. that one 
has data for at least two emission wavelengths X Equation [2] can be re-written as S = E 
A. Then we can write 

A = E-^S 
[3], 

where 

A is a column vector with components a and b, and 

E is the matrix whose columns are the spectral eigenstates, namely [F G]. 

Using equation [3] one can take the observed signal spectrum and calculate the 
abundance of the autofluorescence and of the GFP sources (e.g., the components that 
produce autofluorescence and GFP emission) at the corresponding pixel location. This 
process may be repeated for each pixel in the image, to produce an image of GFP that is 
free of contributions from autofluorescence. As a result, the detection level is greatly 
enhanced. 

Note that the matrix E need only be inverted once for a given set of 
autofluorescence and target compound spectra, so the calculation of abundances is not 
burdensome and can be readily done in nearly real-time by a personal computer. 

The results of this spectral unmixing process are shown ia Figures 6 and 7, which 
present the abundance images for GFP and autofluorescence, respectively. As Figure 6 
shows, it is easy to detect the GFP once it is separated from the autofluorescence. The 
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degree of improvement in the GFP image is striking. Also, one can see that the 
autofluorescence image (Figure 7) is smooth and xmaffected in the region where GFP is 
present, which is consistent with the fact that the presence of GFP in a deep tissue 
structure should not alter the amount of autofluorescence emission from the overlying 

5 dermal regions. 

Overall, an exemplary measurement and analysis process is shown as a block 
diagram in Figure 8. The specimen is prepared and illuminated (step 805) and the 
spectral bands to be acquired determined (step 810). Then the spectral filter is set to 
transmit the spectral weighting function I|, for example, a particular wavelength band 

10 (step 815), and an image corresponding to that spectral weighting function is acquired 
(step 820). The spectral filter is then set to the next spectral weighting function and the 
corresponding image acquired until all bands have been acquired (steps 825 and 830). 
The spectra for the target compound and the autofluorescence are then provided or 
otherwise determined (step 835). Based on the spectra, the matrix E is generated and its 

15 inverse determined (step 840). For each image pixel, the signal spectrum defined by the 
series of acquired images is then midtiplied by the inverse matrix of E (step 845) to 
generate an abundance image of the target compound(s), i.e., the sample image (step 
850). 

In this example, spectral imaging permitted observation of structures in tissue 
20 lying -2 mm within a living organism, where the overlying dermis is at least 300 microns 
thick and has significant autofluorescence. Spectral imaging has also been used to image 
structures at differing depths in other specimens, including non-mammalian specimens 
such as zebrafish. In the latter, the specimen is physically thinner, but once again there is 
the problem of autofluorescence arising from other layers in the specimen, which 
25 confoimds the detection of target compoxmds in the interior of the specimen. While there 
are optical techniques for depth sectioning, such as confocal microscopy, the spectral 
imaging techniques described herein provide a simple and practical altemative. 

An embodiment operating in the infirared range 600 — 11 00 nm may also be 
constmcted using a near-infrared VARISPEC filter such as the model VIS-NIR2-10- 
30 20HC. 

Nothing about tiiese techniques prevents one from viewing multiple target 
compounds per specimen (e.g., m target compoimds). If we denote the number of spectral 
settings as n, matrix E becomes an n x m matrix instead of an n x 2 matrix used in the 
above example. So, one can use these techniques to remove autofluorescence from a 
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sample which contains two target compoimds; or to remove two types of autofluorescence 
from a sample with one or more target compoimds. In any case, the result is the isolation 
of the target compound(s) from the autofluorescence, and the ability to quantify one or all 
of these components. 

The limit to the number of compounds that can be isolated, and l!o the signal to 
noise ratio generally, is given by the shot noise levels and the degree of spectral 
distinction between the emission spectra of the species being distinguished (including 
autofluorescence). One can describe the degree of correlation between two spectra by a 
spectral angle distance ^, defined by 

^ = arccos [(Si • S2) / (N IS2I)] 
[4]. 

I. 

Sets of spectra for which 6 is small for two members are not as easily separated 
into their components. Physically, the reason for this is easily understood: if two spectra 
are only marginally different, it is harder to determine which species was present, and 
noise can easily change one's estimate of relative abundances. Criteria such as 6 can be 
used to help decide what spectral bands are appropriate for a measurement, and one may 
try and select bands that yield a large B whenever possible. Or, one may make an 
empirical study of what bands yield the best separation, by trial and error. It can be 
helpful to include more bands than would appear necessary from mathematical analysis 
alone, in order to reduce sensitivity to slight spectral shifts from the expected shapes, as 
may occur due to variation between specimens and the like. 

Generally, the signal spectrum measured for each spatial location (i.e., pixel) in 
the sample and the estimates of the pure spectra used for the unmixing should typically 
include enough values to provide accurate information about the components of interest. 
For example, for a two-component sample analysis, it is preferable that there be at least 
three values (or more preferably, four or more values) corresponding to different spectral 
weighting functions (e.g., different spectral bands). As the number of components 
increase, the number of values for the signal and pure spectra should also increase. 

It is worth considering the optical efficiency of the measurement apparatus in the 
above embodiment, to understand where the potential improvement provided by these 
techniques comes from. First, the lens used was an F/2.8 type instead of an F/1.2 or F/1.8 
which is more typical for this work, and this choice results in 2.4 - 5.4x less light 
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collection. Next, ttie VARISPEC filter has a transmission of approximately 25 percent, 
and collects over a 25 nm range, in contrast to a typical interference filter which has a 
transmission of 80 percent and collects over a 40 nm range. This fiirther reduces the 
sensitivity by a factor of 5.1x compared to equipment that might be used for this work, for 
an overall reduction in light flux of 12.3x - 27.8x compared to some altematives of the 
art. 

The CCD camera is cooled 25** below ambieat to approximately 0°C, which is 

typical for an ordinary CCD sensor, unlike the sensors used in imaging stations such as 

the ChemiPro system from Roper Scientific (Trenton, NJ)., which is cooled with liquid 

nitrogen to attain temperatures 100° below ambient or lower. 

As this suggests, the effectiveness of these techniques does not arise from extreme 

efficiency in the gathering or collection of light; rather it comes from using spectral 

selectivity to identify and remove the effects of background autofluorescence. 

In other embodiments, the spectral weighting functions may be different from 

passbands. What is important is that the spectral weightings of the various images be 

different. For example, one could use an interferometer to acquire the spectral 

information, as shown in Figure 10 in block-diagram form. The spectral response of the 

interferometer is shown in Figure 1 1 for some selected values of path difference Z. 

Images thus obtained can be used for practicing the invention, either directly or after 

transforaiing from interferograms to spectra. The suitability of vising the interferograms 

can be checked by looking at how well they distinguish between the species involved,- 

which can be determined by measures such as cos 0 or by experimental study. 

The block diagram of Figure 10 is similar to that of Figure 8 except that: steps 

815, 820, 825, and 830 are replaced with corresponding steps 1015, 1020, 1025, and 

1030, which use a interferogram as the spectral weighting function rather than particular 

spectral bands; there is an optional step 1032, which describe Fourier transforming the 

spectrally filtered images to generate a spectral cube; and step 835 is replaced with step 

1035 determines spectra or interferogram weightings for the target compound and the 

autofluorescence consistmt with the form of the acquired data (and optional Fourier 

transform) for use in generating the matrix E. 

The interferometer can be a mechanical type such as a Sagnac design, or it can be 

abirefringent interferometw as described in U.S. Patent 6,421,131, ''Birefringent 

interferometer". The latter uses fixed retarder elements such as quartz plates, together 

with switching apparatus, to make the retarders add or cancel one another, so that using 
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these elements, along with variable retarder elements, one can produce any desired 
retardance within a wide range. When polarized light encounters this assembly, its 
polarization state is changed in a manner that depends on the wavelength of light, and this 
can be detected at an exit analyzer polarizer. The spectral response at any particular 
setting of the interferometer is a sinusoid in lA, after allowing for dispersion. By taking a 
sequence of readings at known retardance values, and performing a fourier transform, the 
spectrum of the light can be determined. Such apparatus can be used in imagmg systems 
to obtain a spectrum at every point in an image, or simply to obtain a set of images widi 
various sinusoidal spectral response functions in the members of the set. ' 

More generally, any spectral imaging apparatus can be used provided that it yields 
adequate spectral information to distinguish emission by the target compound from 
background autofluorescence. 

Accurately Estimat ing Pure Snectra 

We now turn to the question of how the pure spectra F and G in the example 
above were determined, and more generally, how to accurately estimate pure spectra in 
the first place for use in the decomposition (i.e., unmixing) of the signal spectrum into 
their component spectra. Figure 12 shows the steps in block-diagram form of a spectral 
unmixing technique in which one estimates the pure spectra for use as input spectra in the 
spectral unmixing. This step is sometimes referred to as spectral component 
decomposition to obtain pure input spectra. This is not to be confiised with the 
decomposition (or unmixing) of the signal spectrum at each pixel into relative 
contributions of the pure input spectra in the unmixing. The block diagram is similar to 
that of Figure 8, except that step 835 is replaced with performing a spectral component 
decomposition (step 1235) and determining eigenvectors corresponding to the 
autofluorescence and target compoimd(s) (step 1237) for use in the matrix E in step 840. 

In general, any method may be used which yields an adequate estiinate of the 
spectra involved. For some target compounds, there is a known spectrum for the material 
from published references. Alternatively, with a spectral imaging station as described 
herein, one may obtain the spectrum directly by placing a sample containing a sufficient 
conceatration of the target compound in front of the imager and taking its spectrum. 
Conversely, it is often possible to image a region of the specimen where one has a prion 
knowledge that fliere is no target compound in that region, and in tins way one can obtain 
an estimate of that component. Various data analysis techniques can be used in 
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deteimiBing component spectra for spectral unmixing, such as principal component 
analysis (PCA), which identifies the most orthogonal spectral eigenvectors from an image 
cube, and yields score images showing the weighting of each eigenvector throughout the 
image. If PC A analysis is performed on an image that contains contributions from the 
target compound(s) and from the backgrotmd autofluorescence, the vectors from PC A can 
be used to develop estimates of the spectra involved. 

This may be done in combination with other matiiematical processing, and there 
are other known techniques for identifying low-dimensionaUty spectral vectors, such as 
projection piirsuit, a technique described in L. Jimenez and D. Landgrebe, "Hyperspectral 
Data Analysis and Feature Reduction Via Projection Pursuit", IEEE Transactions on 
Geoscience and Remote Sensing. Vol. 37, No. 6, pp. 2653-2667, November 1999. Other 
techniques include iadependent component analysis (ICA), projection pursuit, and end- 
member detection algorithms, for example. 

These techniques are typically not well-suited to the applications in the life 
sciences. For example, some techniques are optimized for spectral imaging data sets tiiat 
contain spectra with dense spectral shs^es and well-defined narrow peaks. Ih some 
techniques the spectral ranges are large compared to the individual spectral features and 
peaks that are used for analysis. The presence of peaks, or the ratio of peaks may be then 
used to classify "end-members" to be separated. Unfortunately, the components in 
biological sample typically do not have such well-defined, narrow peaks. 

Another issue with some techniques is that they output images related to spectra 
that are present in a pure form somewhere within the original image cube. In many cases 
in the life sciences, signal spectra present in the image cube are mixtures of components. 
In the case of the labeled tumor in a mouse, it is unlikely to ever find a location on the 
mouse where tumor exists and the autofluorescence does not. If the component of 
interest is not in a pure form somewhere in the original image cube, then it is unlikely that 
these techniques will output an image that accurately represents the abundance of the 
component of interest. 

There are some techniques, sometimes call 'convex-hull' algorithms, that estimate 
what the true ^d-members are even if they do not exist in a pure form in the image, but 
the effectiveness is dependent on how close signal spectra in the image cube are to the 
end-members. 
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Another issue with some of the techniques is that they operate only in an 
unsupervised way which gives less opportunity to "steer" them in the right direction with 
information that is available from knowledge of the sample. 

When most of these techniques are used with life sciences samples, the output 
images representing abundances of components often do not correlate well with known 
physiological or anatomical features in the samples. Some techniques work weU in some 
cases, while others work well in other cases. 

Shown in Figures 13 A, 13B and 13C are exemplary component abundance images 
generated by atypical non-life sciences (e.g., remote sensing) end-member detection 
algorithm based on the image cube for the moxise of Figure 2. Note that none of the 
output images appear to correspond with just the tumor or just the autofluorescence in the 
skin. 

In the life sciences, and in particular fluorescence appUcations, the spectral 
features are broad and smooth, often spanning most of the detected spectral range. 
Usually the component spectrum (or spectra) of interest, the target fluorescence, shows up 
as a modification to the often larger and overwhelming autofluorescence signal. Key 
information used to analyze samples and determine composition lies in the individual 
detection and quantification of highly overlapping spectral components. Obtaining such 
information is better suited to techniques that are able to opiate on subtle shifts in 
spectral shape. Techniques that are more appropriate for hfe sciences applications should 
be good at first rejecting the largest component, the autofluorescence, and then accurately 
separating away and quantifying smaller, overlapping spectral components. These 
characteristics are distinctly different from those of non-life sciences (e.g., remote 
sensing) applications. 

We have discovered that one approach that does work well for accurately 
estimating pmre spectra for deep tissue imaging is to use one estimate for the pure 
spectrum of one components that is easier to obtain and use it to help reveal the pure 
spectrum of another component from data in the image cube where both components are . 
present Implementations of this include techniques that calculate a remainder spectrum, 
which are described in greater detail further below. 

Remainder Techniques 

Some techniques for reducing the autofluorescence without having a priori 
knowledge of the target compoimd spectrum involve looking at the signal spectrum S(X) 
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for a given pixel, and subtracting from it the maximtun amount of autofluorescence F(X) 
while leaving the remaining signal that is positive definite in all spectral chamiels. That is, 
one defines a so-called remainder spectrum Ra(X) for each pixel: 

Ra(X) = S(X)-aF(X) [5a], 

and then selects the largest value of parameter a consistent with Ra(X) having a non- 
negative value in every spectral channel. The resulting spectrum Ra(X) is then used as the 
signal spectrum, expunged of autofluorescence. One may also make the determination of 
parameter "a" based not on strict non-negative criterion listed above, but on some related 
criteria that incorporates a small negative distribution, to account for considerations such 
as shot noise or detector noise. Additional examples of optimization criteria for removing 
the maximal amount of autofluorescence spectrum include using different error fimctions, 
some of which are described in more detail further below. 

Alternatively, one may sfeek to determine the distribution of the target compound 
by a similar method when its emission spectrum is known, but the autofluorescence 
spectrum is not, by seeking to subtract off from S(X) the maximxmi amount of target 
emission G(X) consistent with a positive remainder, and then reporting the amount that 
was subtracted at each pixel as the image of the target compound. In this case, the 
remainder spectrum Rb(X) for each pixel is given by: 

Rb(X)-S(X)-bG(X) [5b], 

where one selects the largest value of parameter b consistent with Rb(X) having a non- 
negative value in every spectral channel. 

Furthermore, the remainder technique described above in connection with 
Equations 5a and 5b can be expanded to cases where the spectra for one or more 
additional components of the sample are known, and one wants to remove their 
contribution to the signal. In such cases the remainder spectrum is rewritten to subtract a 
contribution of each such component from the observed signal based on the additional 
spectra and consistent with a positive remainder in each spectral channel. 

The remainder technique assumes that an initial estimate for at least one of the 
component spectrum is provided. It can be provided by a prior knowledge or 
measurement, or it can be determined based on the image cube data itself. Li the latter 
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case, it can be deteraiined by user -guidance (i.e., a supervised technique) or without user 
guidance (i.e., an unsupervised technique). For example, a user may be able to identify at 
least one region of the spectral image cube in which one component is nominally isolated, 
and thereby detemiined the pure spectrum for that component from the data in that region 
(e.g., by averaging the signal spectrum from the pixels in that region). In another 
example, without user-guidance, it might be assumed that because autofluoresence will 
donmiant the spectral information in the image cube, one can simply average the spectral 
infomiation in every pixel to determine an estimate for the pure spectrum of the 
autofluorescence. 

Furthemore, the remainder spectrum can be calculated at one, some, or all of the 
pixels. For example, in the two-component case described above, the deep tissue image 
could be constracted directly from the remaind^ spectrum in each pixel, which is now 
assumed to be associated with only the target compound. In other examples, however, 
the remainder spectrum may be calculated for only one, or some pixels, as part of a more 
involved process for estimating pure spectra. Furthermore, the remainder technique may 
be applied to a preprocessed data set derived from the image cube. For example, the 
signal spectrum from some or all of the pixels in the image spectrum may be averaged to 
produce processed signal spectrum to which the remainder technique then is applied. 

The more detailed technique below, which also involves calculating remainder 
spectra, is illustrative of these various possibilities. The techniques works well even with 
image cubes representative of the more difficult samples that one would encounter in 
fluorescence in-vivo imaging, fluorescence microscopy, and bright-field microscopy. 

More detailed example of a remainder technique 
Step 1: Determine Number of Components 

A first step in some techniques for obtaining pure spectra is determining how 
many components are present in a given sample. Some remainder techniques iaclude an 
automated step to delineate or identify areas of a sample that represent or indicate the 
location of what are probably individual components. 

The remainder techniques are able to operate unsupervised, or with a user- 
provided spectrum as a starting point. In the unsupervised mode, a first iteration uses tiie 
average of all the signal spectra in titie image cube as a first "spectral vector" to be 
subtracted. A best-fit approximation is performed at each pixel to determine a quantity of 
the pixel's signal spectrum that can be apportioned to the spectral vector. This quantity of 
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the spectral vector is then subtracted out of the image cube data and a component image is 
generated representing the quantity that was subtracted. In subsequent iterations, it is 
assumed that the areas of highest intensity (after subtractipn) are the next most spectrally 
pure component and those areas are used to obtain the next spectral vector. (The 
"intensity" at a pixel location is calculated by mtegrating the signal spectrum at that pixel 
over all wavelengths.) The number of iterations of subtracting spectral vectors that are 
performed can be specified up firont, or can be continued until the amoxmt of remainder 
signal left over is reduced below a specified percentage. 

This approach has the advantage that often the spectral differences, that are 
"pealed" away and put into separate component images, are often very close to the pure 
spectra from the components. In cases where it is not, some user input is possible to 
guide it. For example, if the first spectral vector is the average spectrum of the whole 
image cube and is not close to one of the component spectra, which may happen for 
example with a shaved mouse instead of a nude mouse, then the user can point in the 

image at what should be autofluorescence, and the process can use that as the first 

*. 

spectral vector. 

Figures 14A, 14B and 14C show output images generated by an xmsupervised 
iterative remainder technique described above on the image cube for the mouse of Figure 
2. Note that these first three components correspond to features that make sense 
anatomically - an autofluorescence image from the skin (Figure 14A), an 
. autofluorescence image from the sebum around hair follicles (Figure 14B), iid the 
labeled tumor image (Figure 14C) with relatively low signal from other components. 

This spectral component decomposition technique is useftd for providing 
component images that indicate to the user where the most significant components are 
and indicate from where in the image spectra should be extracted as input into the next 
iteration. Sometimes the decomposed component spectra are close enough to the actual 
spectra to be good estimates for the pure component spectra. If this is the case, the 
component images generated by the iterative remainder technique are sufficiently pure for 
whatever quantitative analysis is planned, such as tumor measurement or co-localization 
determination. However, sometimes, the decomposed component spectra are not accurate 
enough because the initial spectral vector uses the average spectrum from the entire 
image, and the component images represent some mixtures of components. 
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Step 2: Calculate Pure Component Spectra 

After detennming how many components are present in a given sample, pure 
component spectra can be calculated using the spectra extracted from the image cube data 
using the component images from the iterative remainder technique in step 1. 

One way to do this, and to ftirther improve the accurate apportioning of signal into 
the appropriate component images, is to use the component images from step 1 as a guide 
for further analysis. In other words, step 1 provides initial estimates for the pure spectra 
and component images based on those initial estimates, which can then be used to 
improve the initial estimates of the pure spectra. 

For example, the user can choose component images from the iterative remainder 
technique in step 1, based on knowledge of the sample, that are thought to represent the a 
desired component (e.g., a component that includes a particular target compoxmd) and an 
autofluorescence component that is co-localized with the desired component. The user 
first uses the component images to choose a region (e.g., a set of one or more contiguous 
or non-contiguous pixels) of the image cube corresponding to the autofluorescence 
component without the desired component, which is assigned to spectrum "A." The user 
then uses the component images to choose a region of one or more pixels that show 
strong intensity of the desired component (e.g., the tumor) along with the co-localized 
autofluorescence, which is assigned to spectrum "A + B," 

These regions are then used to indicate pixel locations in the image cube data from 
which to draw the spectrum "A" Sa(X) and the spectrum "A + B" Sa+b(X) used by the 
remainder technique. This process can be repeated for multiple desired components. The 
remainder technique approximates a quantity Q of Sa(X) is present in Sa+b(X) using an 
optimized error function. This quantity of Sa(X) is then subtracted from Sa+b(X) to leave 
the difference spectrum A(X) (with an optional constant offset Q whose optimized value 
is used to estimate the pure spectrum "B" Sb(X). The difference spectrum is given by: 

A(X) = Sa+b(X) Q Sa(X) + C [6]. 

The remainder technique determines optimized values for Q = Q^'", and optionally 
C = C^^^, by minimizing an error function. Any of a variety of possible error functions 
may be used. One exemplary error function err\(A) (where A = A(X) is implicitly a 
function of X) is given by: 
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e77j(A) = (e-^+l)A^ [7]. 

The remainder technique iiiinimizes the average value of err i( A) over X This 
error function erri(A) is chosen to favor values of A that are positive, since a negative 
spectrum Sb(X) is not physically consistent. Alternatively, a minimum mean squared 
error (MMSE) criterion (e.g., errz^A) = A^) can be used along with a constraint that A be 
positive. However, such a strict constraint corresponds to a discontinuous error function 
that may not be as compatible with certaia types of nmiimization techniques. 

Other corrections can also be made. For example, a normalized error function: 
erraCA) = em(A)/[ Sa+b(X) + Sa(X)] [8] 
can be used to correct for larger values of erri (A) being caused by larger values of 
Sa(X) and Sa+b(X) that have the same relative magnitudes. A Value of erri(A).(or of 
erraCA)) whose magnitude is below a noise threshold value can be set to zero. 

Once the optimized values Q^^' and have been calculated, the pure spectrum 
Sb(X) is calculated as follows: 

Sb(X) - Sa+b(X) ~ fi^^' Sa(X) + cr^' [9]. 
Step 3: Unmix Using Pure Component Spectra 

After the piire component spectra are determined in step 2, unmixing can be 
performed on the image cube data using these pure component spectra. This is 
sometimes effective in simple systems if the components are known. However, it may 
not be optimal in some cases because it assumes all measured signal belong to one or 
another of the component images, thus forcing the sum of the signals in the unmixed 
images to equal the total detected signal. If the spectrum in the image cube at a particular 
pixel is made up of more components than is represented by the determined pure 
component spectra, then the unexpected component could and probably will be 
inaccurately apportioned into a target compound image. 

To solve this problem, the iterative remainder technique of step 1 can be used in a 
"supervised" fashion where the spectra from Step 2 are used as input into each iteration to 
"strip ouf ' component images. Each iteration produces a component image that 
corresponds to the spectrum that was used as an input for that iteration. This has the 
advantage that it does not force a sum of 100%, and leaves what is left over in a residual 
image for further processing if desirable. 
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An example of how well this approach works is shown in Figures 15A and 15B. 
Figure 15 A shows the autofluorescence with uniform intensity across the area of the 
tumor, suggesting that the signals were accurately apportioned in the correct images. 
Figure 15B shows the labeled tumor, appearing to be well isolated from other fluorescent 
5 components. 

This capability can be configured in a variety of ways to provicie very effective 
tools for examining and analyzing a sample. For example, it could be configured to 
remove components from a data set as they are pointed to by a user with an input device 
(e.g., a mouse). Spectral components both at the user selected locations and at other 

10 locations in the image cube with the same spectral signature can be removed. The 
spectrum for the selected component can be detemiined using Step 2, and removed as 
described in Step 3. Also, the residual image that contains signal that did not make it into 
a component image can be examined to see if there were any components that were not 
anticipated or known about.. 

15 Any of the steps by themselves and in any combination are useful. Steps 1 and 2 

have value by themselves in many cases. 

Figure 16 is a flow-chart diagram of a process 1600 that is illustrative of the 
iterative remainder technique in step 1 above process. Process 1600 extracts spectral 
vectors that can be used to calculate pure component q)ectra from image cube data. The 

20 resulting pure component spectra can be used as input spectra for unmixing and/or stored 
for later use in an spectral data library. A user provides 1602 image cube data either by 
acquiring the data from a sample or by loading previously acquired image cube data. 

A first spectral vector is then provided by any of a variety of methods. A user 
may select 1604 a first spectral vector from a library of spectra (e.g., a hbrary of spectra 

25 representing various types of autofluorescence for the types of samples being imaged). A 
user may select 1606 a first spectral vector from a region of interest (ROT) based on an 
image that represents autofluorescence (e.g., one of the images in the image cube). A 
user may select 1608 a first spectral vector from a previously acquired image cube. 
Alternatively, the process 1600 automatically determines 1610 a first spectral vector from 

30 the image cube data (e.g., by the averaging the signal spectra from all of the pixels to 
calculate a "mean spectrum"). 

The process 1600 then performs a non-negatively constrained unmixing on the 
image cube to determine 1612 a quantity for each pixel representing the amoimt of the 
current spectral vector that is to be subtracted from that pixel's signal spectrum. At each 
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pixel, the process 1600 subtracts 1614 the largest amoxint of the current spectral vector 
from the signal spectrum that can be subtracted without making the resulting remainder 
spectrum become negative at any wavelength- The process outputs 1616 a component 
image representing the quantity of the current spectral vector that was subtracted at each 
pixel and the corresponding current spectral vector that can be used in subsequent 
processing (e.g., information provided in a component image can be used to locate 
preferred spectra for input into the PCSC process). 

The process 1600 then determines the next spectral vector from a set of one or 
more pixels that represent the largest "error" in the resulting "remainder image cube" 
(i.e., an image cube having the remainder spectra calculated above as signal spectra). For 
example, the process 1600 selects 1618 the next spectral vector as the average of the 
spectra of the most intense N pixels in the remainder image cube (e.g., N = 25). 
Altematively, the process 1600 selects the most intense N pixels and then chooses a 
subset R of the N pixels that are within a specified spectral angle distance 6 of the most 
intense of the N pixels. 

The process 1600 repeats these steps 1612, 1614, 1616 and 1618 until a minimum 
intensity level has been reached or a specified number of spectral vectors have been found 
1620. 

Additional Embodiment 

The techniques above are applicable to a wide range of deep tissue samples, 
including, for example, living organisms, mammels (e.g., humans, rodents, etc.), 
subdermal tissues, organs, etc.. For example, the sample can also be a zebrafish in an 
aqueous sample stage. More generally, the techniques above, for example the techniques 
for estimating pure spectra, can be used for non-deep-tissue biological samples, including, 
e.g., tissue slices, cells, microscope sUde samples. 

The sample holder will depends on sample but, in addition to including sample 
holders for holding an animal such as a mouse, they can include, for example, a culture 
dish, a microtitre plate, a protein array, a DNA array, a gel plate, or a tissue micro array 
plate. For in vivo imaging, the sample may be a surface on which a subject or animal sits, 
rests, or is inmaobilized. 

Of course, target compounds different from GFP may be used. For example, the 

same apparatus may be used to view a mouse, or any other sample, that has been 

transfected to express either the yellow fluorescent protein (YFP) or the red fluorescent 
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protein (RFP), or both, and produces images of the target compound(s) after rraioval of 

the autofluorescence signal. There are also mutant strains developed which may also be 

used. Any of these may be combined with the GFP when that produces useful results. 

Also, for examples, the target compound can be based on quantum dots, which of size 

distributions tailored to provide various spectral signatures. 

In addition to a tunable liquid crystal spectral filter, other embodiments for the 

spectiral filtering are possible, including, for example, an acousto-optical tunable spectral 

filter, a set of spectral filters, a spectral filter wheel, a dispersive prism, a grating, a 

spectrometer, or monochromator. For example, one could use a motorized filter wheel 

contaimng a plurality of bandpass filters. Yet another embodiment coxild use a split-image 

system from Optical Insights (Tucson, AZ) to view the specimen in four spectral bands at 

once, albeit with lower spatial resolution. The bands are chosen to give a spectrum that 

distinguishes between the target compoimd and backgroimd autofluorescence, i.e. to have 

cos d that is significantly different firom 1, preferably 0.8 or less. 

There are also nimierous techniques for obtaining spectrally resolved images. For 

example, some of these techniques include: "'Raster-scaxming" systems where each pixel 

is illuminated and the CTodssion spectrum acquired, and the image is obtained by 

sequentially acquiring each pixel; 'Tush-broom" systems, where spectra are acquired 

firom a hne of the sample by taking the emission light from a line, or strip, of the sample, 

and putting it through an imaging grating to acquire a line of spectra firom the sample, and 

then the sample is moved along under the imaging system (or the imaging system is 

moved over the sample) and another line is acquired imtil an image is built-up; and *True- 

imaging" systems, that take spectrally resolved images of a sample. 

Furthermore, while the above techniques and analysis have focused on situations 

in which the light coming from the sample is spectrally filtered to discriminate between 

selected components. The same algorithms can be applied to the situation in which the 

light used to illuminate the sample is spectrally filtered to discriminate between selected 

components. In other words, rather than focus on the emission spectra of the different 

components in the sample, one can focus on the excitation spectra of the different 

components in fiie sample. In such embodiments, the hght measured from a particular 

region of the sample is spectrally resolved as a fimction of different spectral weighting 

fimctions for the excitation Ught. The basic principle for spectral unmixing remains the 

same, however, because the intensity of the measured light at for each spectral weighting 

fimction will include contributions from different components according to the degree to 
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which those components are excited by light at corresponding to that spectral weighting 
function. For example. Figure 17 shows a spectral imaging system 100' that includes an 
excitation side q)ectral filter 1700 for switching among multiple excitation wavelength 
bands. The resulting image cube data can be processed as described above where, for 
example, the wavelength X in equation [1] is used to denote a given wavelength (or 
wavelength band) of excitation. The illumination source for such technique may be a 
broadband source which is thm spectrally filtered as above, or an array of sources having 
different spectral emission, such as an LED or diode array. Such techniques are also 
further described in U.S. Application No. 10/226,592 (Publication No. US-2003- 
008 1204- Al), which is incorporated herein by reference. Other techniques for providing 
excitation light can also be used such as those described in U.S. Application No. 
10/163,233 (Publication No. US-2003-0223248-A1), incorporated herein by reference. 

Furthemore, in some embodiments, data may be collected as a function of both the 
excitation and emission wavelengths. 

Though the techniques were described above in terais of measuring fluorescence, 
the same techniques can be applied to determining concentration of one or more target 
compounds based on other types of light measurements. The light emission phenomena 
can be based on any of fluorescence, transmission, reflectance, scattering, Raman 
scattering, or phosphorescence. For example, nanoparticles available firom Nanoplex 
Technologies Lac, (www.nanoplex.com) in Menlo Park, CA can be used as target 
compounds that provide Raman emission. Some of these measurements may include 
conversion of measured signals into other units. What is important is that the 
measurement provide spectral information useful to distinguish a desired signal 
corresponding to a target compound from other signal components, and thus to improve 
the measurement integrity and sensitivity. 

For example, some embodiments involve the transmission of Ught through an 
absorbing medium. Under such conditions, tiie intensity of measured light is reduced 
with an exponential dependence upon target compound concentration. However, a 
transform to "optical density*' (e.g., by applying a logarithm function) enables linear 
unmixing techniques. Such optical density techniques are further described in U.S. 
Application No. 10/226,592 (Publication No. US-2003-0081204-A1), incorporated herein 
by reference. Other embodiments may include measurements based on brightness ratios 
at several selected wavelengths or wavelength bands. 
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Embodiments for estimating pure spectra may also include unsupervised 
techniques such as cluster analysis. Cluster analysis identifies regions of the sample that 
have a similar spectral response by clustering the spectra such that tiie differences in the 
intra-cluster spectral responses are mininaized, while simidtaneously maximizing the 
inter-cluster differences between spectral responses. In this implementation, the results of 
a cluster analysis include, for each cluster, the cluster centroid spectrum (viz., the 
weighted mean spectrum for the cluster), and the corresponding cluster membership map 
(viz., the spatial distribution of the cluster). Taken together, they answer two commonly 
posed questions about spectroscopic imaging: where did the different types of spectra 
occur, and what were the spectral characteristics of the spectra. 

Once regions with specific components have been identified through exploratory 
unsupervised analyses, the location of those components can be more thoroughly 
investigated using a supervised classifier. Trainmg set spectra used for the supervised 
classifier can be extracted from regions identified by the unsupervised analyses as 
containing a specific compon^t, or they can be selected firom the data set using previous 
knowledge of the composition of the sample. The supervised classifier can then refine the 
segmentation of the image by locating regions which have spectral profiles matching the 
training spectra. Unsupervised analyses, combined with a supervised classifier, provide a 
means of locating the constituent components without a priori knowledge of the number 
or nature of the components present in the sample. In addition, using the spectra selected 
for the training set as targets in library spectral search routines would also enable an 
. automated identification of the components. 

Supervised pattern recognition methods are potentially better suited to the 
development of clinically or industrially useful data analysis method. Supervised pattem 
recognition techniques such as linear discriminant analysis (LDA) or neural networks 
make use of the fact that the mvestigator often has a substantial amount of spectroscopic 
data available (either biochemical or clinical). For example, the investigator may know 
that spectra arise firom well-defined sample components or tissue types. This information 
may then be used to train a LDA algorithm to recognise the particular combinations of 
variables (peak frequencies, bandwidths, relative intensities, etc.) in the spectra that are 
characteristic of these sample components or tissue types. 

The spectral analysis and construction of the sample image can be implemented in 
hardware or software, or a combination of both. The electronic processing can be 
implemented in computer programs using standard programming techniques following 
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the methods described herem. Program code is applied to input data to perform the 
spectral umnixing functions described herein and generate output information such as the 
sample image. The output information is applied to one or more output devices such as a 
display monitor- 
Each program is preferably implemented in a high level procedural or object 
oriented programming language to communicate with a computer system. However, the 
programs can be implemented in assembly or machine language, if desired. In any case, 
the language can be a compiled or interpreted language. Moreover, the program can run 
on dedicated integrated circuits preprogranmied for that purpose. 

Each such computer program is preferably stored on a storage medixrai or device 
(e.g., CD-ROM or magnetic diskette) readable by a general or special purpose 
programmable computer, for configuring and operating the computer when the storage 
media or device is read by the computer to perform the procedures described herein. The 
computer program can also reside in cache or main memory during program execution. 
For example, computer 180 in Figure 1 may includes a processor, an input/output control 
card, a user interface, such as a keyboard and monitor, and a memory. A program stored 
on a computer-readable medium is stored in the computer memory, and when executed, 
the program causes the processor to carry out the steps of analyziag the spectrally filtered 
images. 

Additional aspects, features, and advantages are within the scope of the following 

claims. 
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